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Abstract —This paper presents a new image based visual servoing (IBVS) control scheme for omnidirectional wheeled 
mobile robots with four Swedish wheels. The contribution is the proposal of a scheme that consider the overall dynamic of 
the system; this means, we put together mechanical and electrical dynamics. The actuators are direct current (DC) motors, 
which imply that the system input signals are armature voltage applied to DC motors. In our control scheme the PD control 
law and eye-to-hand camera configuration are used to compute the armature voltages and to measure system states, 
respectively. Stability proof is performed via Lypunov direct method and LaSalle’s invariance principle. Simulation and 
experimental results were performed in order to validate the theoretical proposal and to show the good performance of the 
posture errors. 
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I. Introduction 

Wheeled mobile robots (WMR) are robotic systems with free motion in a plane, and they have capacity to reach every 
position on the same plane. WMR issues are about how to move them, because they may have or not may have limited 
trajectories to perform. In our case, we are going to study the omnidirectional mobile robots (OMR)[l] whose trajectories 
are not limited. In a more particular way, it is emphasized in OMR with four Swedish wheels [2]. The methodology proposed 
in [3], was chosen to obtain the dynamic model, together with the direct current (DC) motor equations presented in [4]. 

In order to acquire WMR posture by means of computer vision, it is possible to implement global vision systems (GVS). The 
GVS fits in the intelligent space concept [5], [6]. An intelligent space is comprised by sensors (e.g. cameras, microphones, 
ultrasound or laser range finder), computer, actuators and communication devices. The sensors are used to identificate and 
track the objects in the space and/or to receive orders from operators. The computer acquires information from sensors, 
performs image processing, computes control law and communicates with actuators. The intelligent space interacts with 
objects through robotic platforms (e.g. WMR) that provide services like carrying or delivering loads. GVS are used in 
robotics soccer competitions to acquire the posture of every robot on the playground [7], [8]. So, GVS are a good option to 
obtain the posture measurement of WMR. 

The contribution of our paper is the proposal of a new control scheme to OMR posture control in voltage mode, requiring 
only vision system measurements. Furthermore, in our control scheme, the DC motors do not require encoders or drivers 
with current loop or velocity loop. Document is structured as follow. Section 2 presents the problem statement and the 
dynamic model in image space too. Control law and stability proof is presented in Section 3. Simulation and experimental 
results are showed in Section 4. Finally, Section 5 shows our conclusions. 

II. Problem Statement 

First, the dynamic model of the OMR including actuator dynamics is presented. After, camera model (thin lens[9]) and 
camera configuration (Eye-to-Hand[ 10]) are explained. 

2.1 Dynamic model 

Consider an OMR with a two dimensional cartesian coordinate frame called whose center is 0 W and its axes are labeled 
as Riband W 2 . These axes describe a plane where the OMR has free motion. OMR posture on the plane is denoted by 
^ = [x y 6] J (seeFig.l). 

Let^ E M 3 and f E M 3 are the velocity and acceleration vector of the OMR respectively ,u = [Ri ^2 u 3 u a\ j isthe 
armature voltages vector applied to DC motors. The wheels and actuators (DC motors) are labeled as it is depicted in 
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Fig.2Error! Reference source not found..The dynamic model is an Euler-Lagrange system, given by the following state 
space representation: 



= k f a R%(0)E T u-C(e)Z-Df 


( 2 ) 


Where M E M 3x3 is the diagonal positive definite inertia matrix, C\ M -> M 3x3 is the skew-symmetric gyroscopic matrix, 
D E IR 3x3 is the symmetric damping matrix, E E M 4x3 is the jacobian matrix, Rpf ( 9 ) is the rotation matrix from I. R to T. w , 
R a E R is the armature resistance constant and k a E R is the torque constant for each DC motor. 



2.2 Camera model 


Consider the scene depicted in Fig.3. The camera is fixed on the ceiling and oriented to see the robot. The configuration of 
the camera in Fig.3 is called Eye-to-Hand, in the literature[10]. A photoelectric sensor inside of the camera acquires the scene 
image. In order to obtain the construction model of the scene image, it is necessary to have the knowledge of extrinsic 
parameters and intrinsic parameters. First, the coordinate frame £ c is engaged on the sensor surface, the distance Z C3 and 
angleyof £ c respect to Y, w are the extrinsic parameters. Let A E M + be the distance between camera lens and photoelectric 
sensor, a u ,a v E R + be the constants that convert from cartesian space to image space. These latter parameters are called: 
intrinsic parameters. 



FlG.3: Configuration Eye-to-Hand FlG.4: Computer screen 


In order to convert from cartesian space to image space (see Fig.4), we define E M 3 forthe OMR posture in image space 
and it is obtained as follow: 
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( 3 ) 


In order to express the dynamic model (1) and (2) in image space, first and second time derivatives from (3) are computed as 
follow: 



-Xf- 



Xf- 

t/ = 

Vf 

= k c Rw(y)Y 

h = 

Vf 

M 


= k c rUy)1 


( 4 ) 


Solving for fy f, we have 

f = Kc'Rf £ = kf'Rf (yYtf 


( 5 ) 


where R(y) = (RwC y)Y■ Pre-multiplying (2) with R^,( y)and substituting equation (5) the state space representation is 
rewritten as follows: 


T t Sf=Sf 

£MKc Hf = YR F R (e f )E T u - C(e)K?% - DKc'tf 


( 6 ) 

( 7 ) 


with 


*«(»/) 


cos (Of) -sin(fy) 0 

— sin(fy) —cos (Of) 0 
0 0 1 . 


Note that (6) and (7) are the open loop dynamic model of a time invariant system, the input signal u is a vector with the four 
armature voltage of actuators; and the mechanical, electrical and camera parameters are involved in (7). 


III. Posture Control 

3.1 Controller 

Let E IR 3 be the desired posture vector in image space,^ — f^be the posture error vector. The aim of our proposed 
control scheme is to lead the posture error toward zero (i.e. lim^oo | = 0). The proposed control law is given by 

u= GR F R (e f )[K p f f -K d f f \ (8) 

with 
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where k pl , k p2 ,k p3 , k dl ,k d2 ,k d3 E M are positive gains. Substituting the control law (8) in dynamic model (7) we obtain 
closed loop dynamics. It is shown as follows 
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(9) 


j t MKc^ f = A[K p ~Z f - K d f f \ - C(B)Kc% ~ DK?% 


( 10 ) 


With A = — R r (qAe t GR r (6A = — E J G a diagonal positive definite matrix. The closed loop dynamics (9)-(10) has a 
unique equilibrium in |y = 0 E M 3 and4y = 0 E M 3 . 

3.2 Stability proof 

The control law (8) is a PD control law to been implemented in over actuated systems (the number of the degree of freedom 
is lower than the number of actuators or number of control signals). In order to demonstrate stability of the equilibrium, we 
use the following Lyapunov function candidate 


vtff.tf) = +\VfAK v S f 


( 11 ) 


whose total time derivative along of the trajectories of the closed loop equations (9) and (10) is: 

V(Z f ,S f ) = -Zj(AK d +D)Z f (12) 

By satisfying the inequality A K d + D > 0, the equilibrium stability is guaranteed. Thus, in order to study asymptotic stability 
we can apply the LaSalle’s invariance principle [11]. Toward this end, notice that in the set 


5 = 



{f f E R 3 andt/ = 0 E R 3 } 


(13) 


the largest invariant set S is the origin of the closed loop system (9)-(10); i.e., 5 = = 0 E R 3 andf/ = 0 E R 3 }. So, in 

accordance with the Corollary 4.2 of[ll](see page 129 of [11]) the equilibrium t/f — [0 0] T E R 6 is globally 

asymptotically stable. 


IV. Simulations and Experimental results 

Our proposed control scheme is depicted in FlG.5. Simulation was performed in MatLab/Simulink. Used notation and 
parameter values, are shown in TABLE 1. The dynamic model matrices are as follow: 


M = diag {m R + 4%, m R + 4m 81 ,4(m sl l 1 2 + m R1 l% + I Rzl ) + I Rz } + (l Ryl + J m r e 2 )E T E 

\1 1 L ] 

1 ~1 -L ’ °W = +Jmr e 2 e)B,D = Tg (^+ k v )E T E, 

Ll -1 L \ 


E = 



Fig.5: Proposed control scheme 


Experimental results were performed with a RTS VC based software [12] in order to capture and process the images; the 
desired posture vector is (y = [43 53 0] T with initial condition given by^y 0 = [280 210 176] T . Gain values are 
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k pl = 0.5, k p2 = 0.5, k p3 = 10.0, k dl = 0.005, k d2 = 0.005 and k d3 = 1. The experiment was carried out during 10 
seconds with a sample time of 10 milliseconds. Obtained results are depicted in FlG.6, where blue lines are the reference, red 
lines are the experimental results and green lines are the simulation results. The position (i.e. Xf and >y) achieves the 
reference in simulation and experimentation in 1.5 seconds and 3 seconds, respectively. In contrast, the simulation result in 
orientation (i.e., Of) is achieved around 2.5 second and the experimental result has a steady value error reached at 4 seconds, 
because voltage armature computed by the control law is lower for moving the OMR; this is due to the non-modeled static 
friction in the DC motor axes. FlG.7 shows the accomplished path, where red dots represent the position of OMR geometric 
center and green dots represent the position of OMR front part. 


Table 1 

Mechanical and electrical parameters 


Parameter 

Symbol 

Value 

Units 

Mass of the body 

m R 

2.8 

Kg 

Mass of the wheels 

771*1 

0.38 

Kg 

Inertia of the body 

hz 

0.060848 

Kg — m 2 

Wheels inertia in axis rotor 

hyl 

0.000324 

Kg — m 2 

Wheels inertial in perpendicular axis rotor 

hzl 

0.000469 

Kg - m 2 

Distance in 

u 

0.1524 

m 

Distance in R 2 

h 

0.1505 

m 

Wheels radius 

r 

0.42 

m 

Rotor Inertia 

Jm 

5.7 x 10“ 7 

Kg - m 2 

Back-EMF Constant 

k b 

0.01336 

Ns/ 

/ rad 

Torque Constant 

K 

0.0134 

N m / 

/A 

Armature resistance 

R n 

1.9 

Q 

Viscous friction 

ky 

0.001 

Nms/ 

/ rad 

Gear ratio 

r e 

64 

1 


V. Conclusions 


We have presented a new IB VS scheme for OMR with four Swedish wheels. The PD control law was implemented with 
errors in image space. Stability was proven via Lyapunov direct method, and globally asymptotically stability of the closed 
loop system was established by using the LaSalle’s invariance principle. Positive PD gains of the controller are sufficient to 
guarantee asymptotic stability in accordance with the stability proof. Simulations show satisfactory results because the states 
achieved the desired states. Experimental results show a steady state error in the orientation variable, the position reaches to 
desired position. Steady state error is due to non-modeled static friction in the DC motors axes. As long as, the states are 
brought closer to desired states, the computed armature voltage by control law decreases. The above implies that the voltage 
is insufficient to move the remaining angle. A possible solution could be to implement functions like hyperbolic tangent to 
keep a higher voltage near of desired posture. 
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Fig.6: Simulation and experimental results 
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Fig.7 Performed path acquired by the camera 
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